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DIGITAL WATERMARING METHOD AND APPARATUS 



BACKGROUND OF THE INVENTION 

5 1. Technical Field 

The present invention relates to digital watennarking of data, including 
audio, video, and multimedia data. Specifically, the invention relates to 
embedding a watermark signal into digital audio data. 

10 

2. Description of the Related Art 

The proliferation of digitized media such as image, video and multimedia is 
creating a need for security system which facilitates the identification of the 
15 source of the material. Particularly, the internet is increasingly used for 
transmitting recorded music in a digitized foimat:^ Content providers, i.e., 
owners of such recorded music in digital form, have a need to embed into 
multimedia data a predetermined mark which can subsequently be detected by 
software and/or hardware devices for purposes of authenticating copyright 
20 ownership, control and management of the multimedia data. Digital 
watermarking has been developed as a technique for embedding an identifiable 
data into multimedia data. 

Conventionally, a watermark signal used for watermarking audio signal has 
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been relatively simple signals such as a sequence of code symbols because, 
unlike image or video, inserting a large watermark signal would affect original 
audio perceptibility. Therefore, a watermarking technique employing a large 
image as a watermark signal has been proposed. However, prior arts 
5 watermarking techniques involving an image watermark are susceptible to 
unauthorized removal of watermarks, thereby making hard to trace the origin of a 
copyright protected material 

SUMMARY OF THE INVENTION 

10 

An objective of the present invention is to provide a digital watermarking 
technique that does not allow easy removal by an unauthorized person of a 
watermark signal embedded in digital data, particularly audio signal data and yet 
minimize distortion of original data. The objective is achieved in part by 

15 correlating the coefQcients of wavelet transformation of magnimdes of Fourier 
transformed audio signal with the coefficients of discrete cosine transformed 
watermark signal The coefficients of transformed audio signal data and scaled- 
down coefficients of watermark signal are added, inverse wavelet transformed 
and inverse Fourier transformed to produce watermarked audio signal data. 

-0 In accordance with one aspect of the present invention, a method for 

inserting a watermark signal into audio signal data comprises the steps of: Fourier 
transforming audio signal data in the frequency domain in a form of first 
components and second components; wavelet transforming absolute values of the 
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first components to generate first spectral coefficients; discrete cosine 
transforming a watermark signal to generate second spectral coefficients; 
combining the first spectral coefficients and the second spectral coefficients; and 
Inverse wavelet transforming the combined coefficients. 

The first components and second components may be the magnimdes and 
phases of coefficients respectively. Preferably, the step of combining includes a 
step of performing a weighted addition of the first and second spectral 
coefficients. It is preferable for the method to further comprise a step of inverse 
Fourier transforming the output of the inverse wavelet transforming by using the 
phases of coeSicients. Also, it is preferable for the method to further comprise a 
step of multiplying information from the first spectral coefficients to the second 
spectral coefficients prior to the combining step. Further, the method may 
comprise a step of multiplying a scaling factor to the second spectral coefficients 
prior to said combining step. The scaling factor may be in the range of 0.01 - 
0.05. Preferably, the information is a function of the sign of the first spectral 
coefficients. 

In accordance with another aspect of the present invention, a method for 
extracting a watermark from a watermark-embedded audio data comprises the 
steps of Fourier transforming a watermark-embedded audio data and an original 
audio data to generate the first components and the second components 
respectively; Wavelet transforming the absolute magnitudes of the first 
components of the watermark-embedded audio data and the original audio data, 
respectively; taking the differences between wavelet-transform coefficients of the 



watermark-embedded audio data aad the original audio data; and inverse-discrete 
cosine transforming the differences. 

Preferably, the method further comprise a step of multiplying the sign of 
the wavelet-transform coefficients associated with the original audio data to 
wavelet-transform coefficients associated with the watermark-embedded audio 
data. Further, the multiplying step may comprise a step of multiplying a scaling 
factor to wavelet coefficients associated with the watermark-embedded audio 
data. The sign may be obtained by using a signum function. The scaling 
factor may be in the range of 20 1 00. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The aforementioned aspects and other features of the invention will be 
explained in the following description, taken in conjunction with the 
accompanying drawings wherein: 

Fig, 1 is a block diagram for inserting a watermark signal into audio signal 
data according to the present invention; and 

Fig. 2 is a block diagram for extracting a watermark signal from the 
watermark embedded audio signal data. 

DETAILED DESCRIPTION OF THE PREFERRED INVENTION 



Reterring to Fig.1, a digital watermarking method and system according to 



the present invention will be described. 

When a watennark signal is transformed using a transformation scheme, 
the shape of the original watennark is not preserved. The present invention is 
based on the idea that a watennark of an impuJse type is hard to delete because 
the watennark, after inventive transformations, would be distributed over the 
whole transform plane. Thus it helps to prevent unauthorized copying of a 
legitimate data. 

Among many transformation schemes, the present invention employs DCT 
to transform a watermark, because coefficients of DCT transformed plane are real 
values, whereas coeSicients of Fourier-transformed plane have complex 
components, making it more difficult to match with original image data. 

When inserting a watermark (W) into original audio data (S) to form a 
watermark-embedded audio data (S'), the quality of the watermark-embedded 
audio data (S') can be controlled by adjusting the interval between the original 
audio data (S) and the watermark (W) using a scaling parameter a, as shown in 



[Equation 1] 



EgAa 
Eq.lb 



EqAc 



Eq. la is always invertible. Eqs. lb and Ic are invertible when Wi ^ 0. 
If Eqs. lb and Ic are employed, the security of watermarks may not be 
maintained for various processes in multimedia applications. Thus, the present 
5 invention utilizes Eq, la. 

Figs, 1 and 2 show processes of watermarking original digital data and 
extracting the watermarks, in accordance with the present invention. Referring 
to Fig. 1 , a process of watermarking original digital data will be described. 

When original audio data to erabed a watennark is inputted to processing 
10 means (not shown in the figure), the processing means Fourier-transforms the 
original audio data by using a predetermined algorithm to generate amplitude and 
phase components. A Fourier Series is used for the Fourier transform, as 
follows: 

15 [Equations] 
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The process of Fourier-transforming a continuous function f(x) using the 
infinite series of Eq. 2 may be defined as Eq. 3. 



[Equation 3] 

5 

J-co 

For example, 



10 ^(0= i;<^(r-«rj 



1 « 

^0 H=-QO 
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n=~<o 



where 



T 



In the Fourier transform as defined in Eq.3, it is preferable to use complex 
values, since a complex value may represent both the amplitude and phase at a 
] 0 time, as shown below. 



[Equation 4] 



F(u) = R(u) + Mu) 



In Eq. 4, Fourier spectrum is expressed as: 



10 



the phase is expressed as: 



^(u) = tan" 



the power spectrum is expressed as: 
P(u) = \F(uf=RHu) + l\u) 



1 5 where u represents a variable for frequency. 

By employing Euler's equation, i.e., exp[-j27rux] = cos27i:x - j$it)2nx, the 
Fourier transform can be represented by the equation defined in Eq, 5. 
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[Equation 5] 



T{f(x,y)) = Fiu,v) = £ j^f(x,y)cxpl-j27r(ipc-i-vy)]dxdy 
T~'{f(u, v)} = F(x, y)= f r /(w. v)exp[J27riux + vy)]dudv 

Therefore, the Fourier spectrum, phase, and power spectrum can be given 



as follows: 



10 



Fourier spectrum: 

\F(_u,v)\ = [RHu,v) + I\u,v)] 



Phase: 



<I>(M,v) = tan' 



15 



Power spectrum: 

P{u,v) = \Fiu,vf ^ RHu,v) + P(u,v) 



As shown above, Fourier transform employs infinite series to transform 
analog signals to sampled digital signals. However, in order to implement 
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Fourier transform by a computer, modified Fourier transform for sampled data, 
i.e., Discrete Fourier Transform (DFT) is used on behalf of Fourier transform. If 
DFT is employed, f(x) can be given as Eq. 6. 



[Equation 6] 



. 2mn 



10 Al$o,inverseDFT X(e ^ ) is defined as Eq. 7, when the rotational initial 

and maximum value is X[n]. 



[Equation 7] 
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= 2 A."-^] -Period N 
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Digital audio data is Fourier transformed at a Fourier transformer 10 as 
described above while a watermark signal is discrete cosine transfomied at a 
discrete cosine transformer 14. Next, the magnitudes of the coefficients of 
Fourier transformed audio data, obtained by a magnitude extractor 11, are 
wavelet transformed at a wavelet transformer 13, Now the signs (+, -> 0) of the 
audio's coefiScients are respectively multiplied to the spectral coefficients of the 
watermark signal at the first multiplier 3 1 in order to correlate the audio signal 
and the watermark signal to certain extent. The sign can be easily obtained by 
using the slgnum function unit 15, which outputs 1, -I or 0 depending on ttie 
sign/polarity of an input value disregarding the magnitude. The spectral 
coefficients of the watermark signal are further multiplied by a scaling factor a at 
the second multiplier 32 so as not change the audio signal's quality as perceived 
by the listener. The scaling factor is preferably in the range of 0.01 to 0.05. In 
other words the influence of the scaled watermark signal's coefficients on the 
spectral shape of the audio data is minimized so that watermark-embedded audio 
signal is perceptively no different from the original audio signal from the 
perspective of the listener The scaled coefficients are then added to the 
coefficients of wavelet transformed audio signal data at an adder 30. The added 
coefficients are inverse wavelet transformed at an inverse wavelet transformer 16 
to generate adjusted coefficient magnitudes- Finally, the adjusted magnitudes, 
generated by the inverse wavelet transformer, and the phase component of the 
audio signal data, obtained by a phase extractor 12, are input to an inverse 



Fourier transformer 17 to finally generate watermark-embedded audio data. 

Next a watermark extraction from a watermark-embedded audio data will 
be described referring to Fig. 2. A watermark-embedded audio data undergoes a 
Fourier transform at a Fourier transformer 20 to generate a tirst set of coefficients 
in the frequency domain. Simultaneously or independently an original audio data 
is also Fourier transformed at a Fourier transfomier 23 to generate a second set of 
coeflBcients in the frequency domain. The magnitudes of the two set of 
coefficients, obtained by magnitude extractors 21 and 24 respectively, are further 
wavelet transformed at wavelet transformers 22 and 25 respectively. The 
wavelet coefficients associated with the original audio data are subtracted from 
those with the watermark-embedded audio signal at a subtracter 33, The 
differences in the coefficients are multiplied by a scaling factor (l/a) and the sign 
(1 for positive, 0 for none and -1 for negative) of the wavelet transform 
coefficients associated with the original audio data at a multiplier 34. The sign 
can be obtained by using a signum function unit 26. Finally, the scaled 
coefficients, multiplied by the output of the signum- function unit 26 is inverse 
discrete cosine transformed at an inverse discrete cosine transformer 27 to 
produce a watermark which had been embedded in the original audio data. 

The watermarking method described above can be implemented on a single 
chip integrated circuit or discrete components. Specifically, a digital signal 
processor may be programmed to perform the steps in the inventive 
watermarking. 

While there has been described and illustrated a method and system for 



- 13' 



inserting a watermark data by discrete cosine transforming the watermark signal 
and Fourier/ wavelet transforming an original audio data, it will be apparent to 
those skill in the art that variations and modifications are possible without 
deviating from the broad principles and teachings of the present invention which 
shall be limited solely by the scope of the claims appended hereto. 
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What is claimed is; 

1, A method for inserting a watermark signal into audio signal data, 
comprising the steps of: 

Fourier transforming audio signal data in tlie frequency domain in a form of 
first components and second components; 

wavelet transforming absolute values of said first components to generate 
first spectral coefEicients; 

discrete cosine transforming a watermark signal to generate second spectra! 
coefficients; 

combining said first spectral coefficients and said second spectral 
coefficients; and 

Inverse wavelet transforming the combined coefficients, 

2, The method for inserting a watermark signal into audio signal data a$ 
claimed in claim 1, wherein said first components and second components are the 
magnitudes and phases of coefficients respectively. 

3. The method for inserting a watermark signal into audio signal data as 
claimed in claim 1, wherein said step of combining includes a step of performing 
a weighted addition of said first and second spectral coefficients. 

4. The method for inserting a watermark signal into audio signal data as 
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claimed in claim 3, further comprising a step of inverse Fourier transforming the 
output of said inverse wavelet transforming by using said phases of coefficients. 

5. The method for inserting a v^aterrnark signal into audio signal data as 
claimed in claim 4, further comprising a step of multiplying an information from 
said first spectral coefficients to said second spectral coefficients prior to 
combining step. 

6. The method for inserting a watermark signal into audio signal data as 
claimed in claim 5, further comprising a step of multiplying a scaling factor to 
said second spectral coefficients prior to said combining step. 

7. The method for inserting a watermark signal into audio signal data as 
claimed m claim 6, wherein said scaling factor is in the range of 0.01 - 0.05. 

8. The method for inserting a watermark signal- into audio signal data as 
claimed in claim 5, wherein said information is a function of the sign of said first 
spectral coefficients. 

9. An apparatus for inserting a watermark signal into audio signal data, 
comprising: 

a means for Fourier transforming audio signal data into amplitude 
components and phase components; 
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a means for wavelet transfonning absolute values of said amplitude 
components to generate first spectral coefficients; 

a means for discrete cosine transforming a watermark signal to generate 
second spectral coefficients; 

a means for combining said second spectral coefficients to said first spectral 

coefiScients respectively; and 

inverse wavelet transforming the coefficients. 

10. The apparatus for inserting a watennark signal into audio signal data as 
claimed in claim 9, wherein said combining means comprises a means for 
multiplying an information from said first spectral coefficients to said second 
spectral coefficients. 

1 1 . The apparatus for inserting a wateraiark signal into audio signal data as 
claimed in claim 10, wherein said combining means comprises a means for 
muhiplying a scaling factor to said second spectral coefficients. 

12. The apparatus for inserting a watermark signal into audio signal data as 
claimed in claim 1 1 , wherein said scaling factor is in the range of 0,01 ~ 0.05, 

13. The apparatus for inserting a watermark signal into audio signal data as 
claimed in claim 9, fiirther comprising a means for inverse Fourier transforming 
said respectively combined coeflficients using said phase components. 
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14. The apparatus for inserting a watermark signal into audio signal data as 
claimed in claim 10, wherein said information is a function of the sign of said 
first spectral coefficients, 

5 

15. A method for extracting a watermark from a watermark-embedded audio 
data, comprising steps of: 

Fourier transforming a watermark-embedded audio data and an original 
audio data to generate first components and second components respectively; 
10 Wavelet transforming the absolute magnitudes of said first components of 

said watermark-embedded audio data and said original audio data respectively; 

taking the differences between wavelet-transform coefficients of said 
watermark-embedded audio data and said original audio data; and 

inverse-discrete cosine transforming said differences. 

15 

16. The method for extracting a watermark from a watermark-embedded audio 
data as claimed in claim 15, further comprising a step of multiplying the sign of 
said wavelet-transforai coefficients associated witli said original audio data to 
wavelet-transform coefficients associated with said watermark-embedded audio 

20 data. 

17. The method for extracting a watermark from a watermark-embedded audio 
data as claimed in claim 16, wherein said multiplying step further comprises a 
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step of multiplying a scaling factor to wavelet coefficients associated with said 
watermark-embedded audio data* 

18. The method for extracting a watermark from a watermark-embedded audio 
5 data as claimed in claim 16, wherein said sign is obtained by using a signum 

function, 

19. The method for extracting a watermark from a watermark-embedded 
audio data as claimed in claim 17, wherein said scaling factor is in the range of 

10 20-100. 

20. An apparatus for extracting a watermark from a watermark-embedded 
audio data, comprising: 

a means for Fourier transforming a watermark-embedded audio data and an 
15 original audio data to generate first components and second components 
respectively; 

a means for wavelet transforming the absolute magnitudes of said first 
components of said watermark-embedded audio data and said original audio data 
respectively; 

20 a means for taking the differences between wavelet-transform coefficients 

of said watermark-embedded audio data and said original audio data; and 
a means for inverse-discrete cosine transfonning said differences. 
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2L The apparatus for extracting a watermark from a watermark-embedded 
audio data as claimed in claim 20, further comprising a means for multiplying the 
sign of said wavelet-transform coefficients associated with said original audio 
data to wavelet-transform coefficients associated with said watermark-embedded 
5 audio data. 

22. The apparatus for extracting a watermark from a watermark-embedded 
audio data as claimed in claim 21 , further comprising the means for multiplying a 
scaling factor to wavelet-transform coefficients associated with said watermark- 

10 embedded audio data, 

23. The apparatus for extracting a watermark from a watermark-embedded 
audio data as claimed in claim 21, wherein said sign is obtained by using a 
signum function. 

15 

24. The apparatus for extracting a watermark from a watermark-embedded 
audio data as claimed in claim 22, wherein said scaling factor is in the range of 
20^100. 
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ABSTRACT OF THE DISCLOSURE 



Digital watermarking of digital audio is performed by Fourier 
transforming digital audio data, wavelet transforming the magnitude components 
5 of the Fourier transform coefficients of the digital audio data, discrete cosine 
transforming a watermark signal, multiplying the sign of the wavelet transform 
coefficients of the magnitude components to the coefficients of the discrete 
cosine transformed watermark signal, adding the coefficients of the Fourier 
transformed digital audio data and the adjusted discrete cosine transformed 
10 watermark signal, and inverse wavelet transforming the audio signal's 
coefficients before inverse Fourier transformation to finally generate watermark- 
embedded audio signal data. 
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app!tcai!on is not Gisciosed m the prior United States or PCT 
Iniernapcna! application in the manner provided by the first 
paragrapn of Title 35, United States Code, §112, I acknowledge 
the duty to disclose information which is material to patentability as 
defined in Title 37. Code of Federal Regulations. §1.56 v/hich 
became available between the filing date of the prior application 
and the national or PCT international filing date of this application 



(Application No,) (Filing Date) 

mm ^s) (mm mx\) 



(Application No.) (Filing Date) 

(mm yg) (mm mxD 

^eioi ofe m\x\ ovm xiig^ iHgoi Af^'oin, xhb 
E ssu ±w\ Ai^si mm\uL BUO\y\ umm^ 
x-iii8§oi x-iiiooiio(i ^xm H\9} mo\ n^iei m\ 2^ ^ 0121 
^xm 1^1^ ^^oiu ¥^2^ x]^ ^?\u mE2\ ^^mm 

^ 2^11 oiE-iti ii£|o| m\ sa8 mm mmoiu m\ m^s 
mm9.\ mm-n le eixiaisx-i 0171011 B^mm ^2im 

LO. 



(Status- Patented. Pending, Abandoned) 

(mm mm m^, mmm, 571) 



(Status: Patented, Pending. Abandoned) ! 

i 
j 

I hereby declare that all statements made herein of my own j 
knowledge are true and that all statements made on information j 
and belief are believed to be xrue; and further that these statements 1 
were made with the knowledge that willful false statements and the : 
like so made are punishable by fine or imprisonment, or both, under i 
Section 1001 of Title 1B of the United States Code and that such 
willful faise statements may jeopardize the validity of the application | 
or any patent issued thereon | 
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Korean Language Declaration 



?igJS|: Xm^ ^^X\^M 01 m^S fi^sa 0\2} ^ power of ATTORNEY: As a named inventor, I hereby 

^<5[01 mti ^ 1^5^01 ^^2 xiE\t5\y\ ^mM m appoint the following attomey(s) and/or agent{sl to prosecute 

y\ ^^MCm) ^/EE^ a\Z\2\(m)m 21^mun. ^ m this application and transact all business in the Patent and 

yj^) Trademark Office connected therewith: (List name and 

registration number) 

Norman F. Obion. Reg. No. 24,618; Marvin J. Spivak, Reg. No. 24,913; C. irvin McClelland, Reg. No. 21,124; Gregory J. Maier. Reg. No. 
25,599; Arthur i. Neustadt, Reg. No. 24,854; Richard D. Kelly. Reg. No. 27.757; James D. Hamilton, Reg. No. 28,421 ; Eckhard H. Kuesters, 
Reg, No. 28,870; Robert T. Rous, Reg. No. 29.099; Charles L. Gholz, Reg. No. 26,395; Vincent J. Sunderdick, Reg. No. 29.004; William E.' 
Beaumont, Reg. No. 30.996; Robert F. Gnuse, Reg. No. 27,295; Jean-Paul Lavalleye, Reg. No. 31 .451 ; Stephen G. Baxter, Reg. No. 32,884; 
Martin M, Zoltick, Reg. No. 35,745; Robert W. Hahl, Reg. No. 33,893; Richard t. Treanor, Reg. No. 36,379; Steven R Weihrouch, Reg'. No! 
32,829; John T. Goolkasian. Reg. No. 26,142; Richard L, Chinn, Reg. No. 34,305; Steven E. Lipman, Reg. No. 30,01 1 ; Carl E. Schlier, Reg. 
No. 34,426; James J. Kulbaski, Reg. No. 34,648; Richard A. Neifeld. Reg. No. 35,299; J. Derek Mason, Reg. No. 35.270; Surinder Sachar, 
Reg. No. 34,423; Christina M. Gadiano. Reg. No. 37,628; Jeffrey B. Mclntyre, Reg. No. 36.867; and Paui E. Rauch, Reg. No. 38,591 , with full 
powers of substitution and revocation. 



Ai^J n^^dXI-: Send Correspondence to: 

OBLON, SPIVAK, McCLELLAND. MAIER & NEUSTADT, PC. 
FOURTH FLOOR 
1755 JEFFERSON DAVIS HIGHWAY 
ARLINGTON, ViRGiNiA 22202 U.S.A. 







Direct Telephone Calls to: (name and telephone number) 
(703) 413-3000 






Full nsmp nf ^nlts nr ftr^t invontrtr 

Jong Uk CHOI 






Inventor' s signa^re ^ Date 






§fesidence Sungwon Apt. 2-1301, Uooeu 1-Dong 
Kangbuk-Ku, Seoul, Republic of Korea 






Citizenship 

Republic of Korea 






Post Office Address 

Same as above 










□|o| olog ^yjKjj a^sxfoi ois 


Full name of second joint inventor, if any 
Jung Seok CHO 




¥Sj^ a^sxf£! km sixf 


Secqod Inventor' s signature / Date 






Residenfg 23/7, 1160-36, Shinjung 3-Dong 
Yangchun-Ku, Seoul, Republic of Korea 






Citizenship 

Republic of Korea 






Post Office Address 

Same as above 








{kmm nam ^f^oi ^^iix^soii ch?^ ^km sssi -i=o| 

AHSS 5!.) 


(Supply information and signature for third and subsequent joint 
inventors.) 
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Korean Language Declaration 



Fuii name oJ third joint inventor, tf any 

Jonq Weon KIM 



Date 



R^siS^nce Hanmaeul Apt. 111-401, 54/5, 200-^= 
Sonqqang-Dong, Yoosmg-Ku, Daejeon, Repub lic 

Citizenship Of KOJje^ 

Republic of Korea 



^21 



Post Office Address 

Same as above 





Fuii name of fourth jojnt inventor, if any 






Fourth Inventor's signature 


Date 




Residence 


; ^^ 


Citizenship 




Post Oftice Address 











Full name of fifth joint inventor, if any 




^Xt 


Fifth Inventor" s signature Date 


J >i^A! 




Residence 




Citizenship 




Post Office Address 










Full name of sixth joint inventor, if any 




^Xt 


Sixth Inventor' s signature Dale 




Residence 




Citizenship 




Pos* Office Address 










(Supply similar information and signature for third and subsequent joint 
inventors.) 
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